Abstract: Transliteration: The process of transcription from one language to another is an inevitable part of Machine Translation. It is concerned about Out-of-Vocabulary words or Named Entities and Proper Nouns which requires its phoneme or sound preservation across the language. It can be done in a supervised or unsupervised way. But there is no good method which does this in Malayalam language. Deep Learning is an emerging stream which can be used in the implementation of the same. This paper throws light into such a method which is used to implement Machine Transliteration in Malayalam using Deep Learning using unsupervised training method.

Keywords: Transliteration, Unsupervised Learning, Deep Learning, Deep Belief Nets (DBN), Restricted Boltzmann Machine (RBM).